1 link tagged with all of: evaluation + ai + anthropic + writing quality
Click any tag below to further narrow down your results
Links
A researcher at Arize built a rigorous evaluation system to test whether Claude Opus 5.5 actually fixed the distinctive writing quirks that plague Claude outputs. The answer: it improved by 50%, but "fixed" overstates it — the model still relies heavily on rhetorical moves that make AI-generated text feel artificial.
- Em dashes dropped dramatically (from 12.9 to 0.035 per 1,000 words), but other Claudisms only halved across six categories: salience flags, verdict intensifiers, signposts, contrast reframes, stock metaphors, and gotcha framing.
- The real problem isn't specific phrases—it's rhetorical moves. Claude doesn't say "load-bearing" that often, but it constantly tells readers something matters instead of showing why, which no phrase list can catch.
- Evaluating writing quality requires human annotation first, then building automated checks against those annotations. The researcher manually flagged 153 instances across 53,000 words to create ground truth before training an LLM judge.